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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
07/18/2008 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-4, 6-9, 11,12, 14 and 20 have 
been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-4, 6-9, 11, 14 and 20 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nakano et al. (hereinafter 'Nakano', Pub. No. 2003/0070173) in view 
of Logan et al. (hereinafter 'Logan', Pub. No. 2008/0092168). 
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Regarding claims 1, 6 and 20, Nakano teaches a media data audio-visual device 
for viewing media data, comprising (Video recorder 11, Fig. 2, connected to a display 
device, which displays media data as shown in Figs. 1 or input/output device 51, 
Fig. 13): 

an audio-visual portion configured to display the media data (Video recorder 11, 
Fig. 2, connected to a display device, which displays media data as shown in 
Figs. 1 or input/output device 51, Fig. 13); 

a metadata storing portion configured to store metadata corresponding to the 
media data (Database 26, Fig. 3; [0041]-[0042], [0046]-[0049]); 

a communication portion configured to transmit the metadata externally and 
receive external metadata to be stored in the metadata storing portion 
(Communications Interface 44, Fig. 13; [0042]; [0175]); 

a display portion configured to display a time relationship between selected 
media data and selected metadata based on time data embedded in the media data 
and in the metadata (When an image is sent or transmitted to the client, the 
database with the metadata is referenced to present the metadata with the 
content, [0036] lines 18-22; and given that the metadata contains time of 
presentation, etc, [0036] lines 1-17, both are related in time and are displayed to 
the user). 

On the other hand, Nakano does not explicitly teach a synchronizing portion 
configured to extract a feature amount that is stored in the metadata, search for 
corresponding feature amount in associated media data, and to synchronize the 
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metadata with the associated media data to correct any time differences between the 
metadata and the media data caused by inaccurate time data in the metadata. 

However, in an analogous art, Logan teaches a set-top box ([0019]-[0023]) that 
receives metadata for video content that includes not only information about displaying 
time of the content, but other feature amount information ([0077]-[0084])) that will help 
to synchronize video data with its respective metadata to solve a time shift or time 
difference problem ([0083]). 

Therefore, it would have been obvious at the time of the invention to have 
modified Nakano's invention with Logan's feature of including feature amount 
information or characteristic information for the benefit of making sure that a given 
frame or segment is the one that is supposed to be presented along with a given portion 
of metadata, and in this way, avoiding presentation time mismatching due to missing 
frames, transmission delays and/or erroneous device's local clock time (Logan: [0077]). 

Regarding claims 2 and 9, Nakano and Logan teach a media data audio-visual 
device, further comprising a metadata creating portion configured to enable a user to 
create metadata (Database Generating Unit 25, Fig. 3, [0036], [0041], [0048] -[0049]). 

Regarding claim 3, Nakano and Logan teach a media data audio-visual device 
wherein the metadata creating portion includes a disclosure selection tool configured to 
enable a user to designate whether created metadata is to be disclosed externally 
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(Changes made by the user are assigned a 1 if the changes are meant to be local 
or global -shared with others, [0093]). 

Regarding claims 4, 8, and 11, Nakano and Logan teach a media data audio- 
visual device further comprising a search condition a inputting portion configured to 
enable a user to input search conditions for searching the external metadata (User is 
able to search for metadata in the server, internet or other clients, [0053]-[0055], 
[0136]-[0160], [0163], [0175]. The user selects to see or not the results, as for 
example the URL treated in [0094]-[0095]). 

Regarding claim 7, Nakano teaches a metadata sharing system 

comprising: 

a plurality of client media data audio-visual devices each configured to display 
media data and metadata corresponding to the media data ([0175]); and 

a server configured to exchange data among the plurality of client media data 
audio-visual devices (Delivery server 10, Fig. 2; [0048]-[0055]), wherein each of the 
plurality of client media data audio-visual devices includes: 

an audio-visual portion configured to display the media data (Video recorder 11, 
Fig. 2, connected to a display device, which displays media data as shown in 
Figs. 1 or input/output device 51, Fig. 13); 

a metadata storing portion configured to store metadata corresponding to the 
media data (Database 26, Fig. 3; [0041]-[0042], [0046]-[0049]); 
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a communication portion configured to transmit the metadata externally and 
receive external metadata to be stored in the metadata storing portion 
(Communications Interface 44, Fig. 13; [0042]; [0175]); 

wherein the server includes a metadata storing portion configured to store the 
metadata transmitted from the plurality of client media data audio-visual devices 
(Database 34, Fig. 4, [0043]-[0045]); 

wherein each of the plurality of client media data audio-visual devices includes a 
search request inputting portion configured to enable a user to input a search request 
for searching the metadata stored in the server, and wherein the server includes a 
metadata searching portion configured to search for the metadata in the metadata 
storing portion that corresponds to the search request (User is able to search for 
metadata in the server, internet or other clients, [0053]-[0055], [01 36] -[01 60], 
[0163], [0175]. The user selects to see or not the results, as for example the URL 
treated in [0094]-[0095]), and 

a display portion configured to display a time relationship between the 
media data and the received metadata based on time data included in the received 
metadata and in the media data (When an image is sent or transmitted to the client, 
the database with the metadata is referenced to present the metadata with the 
content, [0036] lines 18-22; and given that the metadata contains time of 
presentation, etc, [0036] lines 1-17, both are related in time and are displayed to 
the user), 
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incrementing a value associated with the metadata creator data each time the 
specific metadata is exchanged among the plurality of client media data audio-visual 
devices (Every time a client requests for metadata content, a counter is increased, 
and if the count surpasses a threshold value, a request for changing the metadata 
database at the server from a client is registered, [01 66] -[01 67]. 

Although Nakano teaches that the users can create metadata as well as the 
delivery server, and that the server helps other users to find requested image data and 
with corresponding metadata stored at another user's equipment, Nakano does not 
explicitly teach wherein the server includes a metadata creator data storing portion 
configured to store metadata creator data identifying a creator of specific metadata and 
wherein the metadata creator data is added to the search request of the search request 
inputting portion, and wherein the creator of the specific metadata does not correspond 
to a client media data audio-visual device at which a search request for searching for 
the specific metadata was input. 

However, in an analogous art, Logan teaches a metadata sharing system in 
which a user creates metadata that can be used to replace or modify the server- 
produced metadata. Logan also teaches that the user created metadata can be shared 
to other users. The server stores the creator's information by registering the location 
where the user-created content resides (resource address; [0087]) and serves as the 
registry or directory when a given user requests additional content ([0086]-[0100]). In 
other words, the server stores information about the creator of metadata (its location or 
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how to be contacted. The creator is different from the server or the requesting device) 
and shows it to the requesting user. 

Therefore, it would have been obvious to an ordinary skilled in the art at the time 
of the invention to have modified Nakano's invention with Logan's feature of storing 
information about the creator and presenting it to a third device when requested for the 
benefit of saving storage capacity at the server by not having to store all the user- 
created or modified metadata from all the users. 

5. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nakano 
et al. (hereinafter 'Nakano', Pub. No. 2003/0070173) in view of Logan et al. (hereinafter 
'Logan', Pub. No. 2008/0092168) as applied to claim 7 above, and further in view of Wilf 
(Pub. No. 2001/0049826). 

Regarding claim 12, Nakano and Logan teach all the limitations of the claim it 
depends on. Nakano also teaches an interface to search for metadata corresponding to 
media (User is able to search for metadata in the server, internet or other clients, 
[0053]-[0055], [0136]-[0160], [0163], [0175]. The user selects to see or not the 
results, as for example the URL treated in [0094] -[0095]. For any search, it is 
inherent that there must be an interface to transmit user's inquiry to the 
content/metadata source). On the other hand, Nakano and Logan do not explicitly 
teach being able to set a recording reservation to record the media data scheduled to 
be broadcast in the future using search results from the metadata searching portion. 
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However, in an analogous art, Wilf teaches a system that indexes and performs 
segmentation on video inputs and lets the user search for content through queries. 
Based on the result, a recording timer can be set for content that will be presented in 
the future, based on programming listings on the internet (Abstract, [0004], [0014]- 
[0015], [0038], [0068], [0082]). 

Therefore, it would have been obvious to an ordinary skilled in the art at the time 
of the invention to have modified Nakano and Logan's invention with Wilfs setting 
recording timers on program listings matching user's queries for the benefit of letting the 
user watch the matching content in the case he/she is not at home to watch it. 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to OMAR PARRA whose telephone number is (571)270- 
1449. The examiner can normally be reached on 9-6 PM (M-F, every other Friday off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Miller can be reached on 571-272-7353. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/John W. Miller/ 

Supervisory Patent Examiner, Art Unit 2421 
OP 



